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DETAILED ACTION 

1 . This action is in response to the following communication: Amendment to 
application 10/829,417 filed September 2"^ 2008. 

2. Claims 6, 7, 13-14, 16, 18-21, 23, 24, 26, 27, 30, 55, 56, 59, 62, and 72 have 
been amended. 

Claims 1-81 remains pending. 

Claims 1, 8, 13, 16, 20, 23, 26, 28, 31, 34, 45, 51, 55, 57, 59, 62, 64, 70, 75, 76, 

and 78 are independent claims. 

Specification 

3. Prior objection is overcome by corrections. 

Claim Objections 

4. Prior objection is overcome by corrections. 

Claim Rejections - 35 USC §112 

5. Claim 26 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 

Claim 26 recites the limitation "the non-procedural image annotation template" in 
lines 2-3 of the claim. There is insufficient antecedent basis for this limitation in the 
claim. 

6. Prior rejection is overcome by corrections. 
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Claim Rejections - 35 USC § 101 

7. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 26 and 55 are rejected under 35 U.S.C. 101 because the claimed 
invention is directed to non-statutory subject matter. 

Claims26 and 55 recites a "high-level language system" comprising an 
"apparatus" that has been reasonably interpreted as a computer program, software, 
listing per se (see Fig. 7, Fig. 8, and paragraph [0072], lines 1 of the specification). 
Claims 26 and 55 fails to recite the "high-level language system" comprising an 
"apparatus" as stored on an appropriate computer readable medium, which defines 
structural and functional interrelationships between the software and other components 
of a computer that permit the software's functionality to be realized - see MPEP 
2106.01(1). Therefore, claims 26 and 55 are rejected as non-statutory. 

Claims 27 and 56 mirror the deficiencies of claims 26 and 55, and are also 
rejected as non-statutory. 

8. In regards to claims 1, 8, 13, 20, 28, 31, 34, 45, 59, 62, 64, and 70, prior 
rejection is overcome by corrections. 

Claim Rejections - 35 USC § 102 

9. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 
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A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

10. Claims 1, 4 - 6, 16, and 18 - 21 are rejected under 35 U.S.C. 102(b) as 
being anticipated by Jain et al. (Iiereinafter Jain), US 2002/0073091. 

In regards to claim 1, Jain teaches: 
• a translator that is operable to receive a non-procedural image annotation 
template (Fig. 1, note arrow from #104 to #108, and arrow from #102 to #120), 
(p. 1, [0003], lines 1 - 6, "a Document Type Definition file ("DTD") associated 
with an XML document defines how the mark up tags within the document should 
be interpreted by the application presenting the document. The HTML 
specification that defines how Web pages should be displayed by Web browsers 
is one example of a DTD"), and (p. 1 , [0002], lines 1-9, "XML or extensible 
Markup language is a language designed specifically for documents that contain 
structured Information... The content may be, for example, words, pictures , etc. A 
document in the XML context refers not only to traditional documents, but also to 
other XML "data formats," which include vector graphics , mathematical 
equations, object meta-data, and other kinds of structured information") 
(emphasis added). Examiner notes that pictures and vector graphics are 
references to "image", "imaging", "imager" or "imaged"; and although the exact 
nomenclature isn't used, the functionality is very much the same as Applicant's 
now claimed invention (emphasis added). 
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• the translator being operable to translate the non-procedural image annotation 
template to image annotation source code (Fig. 1, #104 XML DTD, #108 
XML_To_JAVA, #1 10 Java Class, #112 Java Class File, #120 Program, #124 
Java Object), (p. 1 ,[001 1-0012], see techniques are disclosed for converting an 
XML document to an object in an object-oriented language, thereby providing a 
structured, programmatic, consistent, powerful, and in-memory method for 
accessing the data in the XML document... In one embodiment, a translation tool 
converts an XML DTD associated with the XML document to Java classes from 
which a Java object corresponding to the XML document is instantiated), and (p. 
4, [0070], lines 6-13, "the set of viewing information includes: a) document 
information representing a selected file (document) in a format viewable in the 
Web browser (e.g., a Hyper-Text Mark-up Language (HTML) file); b) annotation 
information representing annotations in a format viewable in the Web browser 
(e.g., an HTML file); and c) a script for allocating the annotations to the file 
(document) (e.g., a JavaScript))". Examiner notes that a "JavaScript and HTML 
file" which contains " annotation information representing annotations in a format 
viewable in the Web browser" are "non-procedural image annotation template", 
and although the exact nomenclature isn't used, the functionality is very much the 
same as Applicant's now claimed invention. 

• a compiler operably coupled to the translator, the compiler being operable to 
receive the image annotation source code and to compile the source code into 
an image annotation executable (Fig. 1, #104 XML DTD, #108 XML_To_JAVA, 
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#1 1 0 Java Class, #1 1 2 Java Class File, #1 20 Program , #1 24 Java Object ), (p. 
1 ,[001 1-0012], see Techniques are disclosed for converting an XML document to 
an object in an object-oriented language, thereby providing a structured, 
programmatic, consistent, powerful, and in-memory method for accessing the 
data in the XML document... In one embodiment, a translation tool converts an 
XML DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated), and (p. 4, [0070], 
lines 6-13, "the set of viewing information includes: a) document information 
representing a selected file (document) in a format viewable In the Web browser 
(e.g., a Hvper-Text Mark-up Language (HTML) file); b) annotation information 
representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) 
(e.g., a JavaScript))". Examiner notes that a "JavaScript and HTML files" are 
executable files, which are executed via a Web Browser, and although the exact 
nomenclature isn't used, the functionality is very much the same as Applicant's 
now claimed invention. 

In regards to claim 4, Jain teaches: 

• an iterator object for an expression tree of the non-procedural image annotation 
template (Fig. 2, Fig. 3). 

• a lexical analyzer of the procedural image annotation template (Fig. 1 , #1 04 XML 
DTD, #108 XML_To_JAVA, #1 10 Java Class, #112 Java Class File, #120 
Program, #124 Java Object), and (p. 1, [001 1-0012], see Techniques are 
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disclosed for converting an XML document to an object in an object-oriented 
language, thereby providing a structured, programmatic, consistent, powerful, 
and in-memory method for accessing the data in the XML document... In one 
embodiment, a translation tool converts an XML DTD associated with the XML 
document to Java classes from which a Java object corresponding to the XML 
document is instantiated). 

In regards to claim 5, Jain teaches: 
the image annotation source code further comprises an object-oriented image 
annotation source code and the compiler further comprises an object-oriented compiler 
(Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, #112 Java Class File, 
#120 Program, #124 Java Object), and (p. 1, [001 1-001 2], see Techniques are disclosed 
for converting an XML document to an object in an object-oriented language, thereby 
providing a structured, programmatic, consistent, powerful, and in-memory method for 
accessing the data in the XML document... In one embodiment, a translation tool 
converts an XML DTD associated with the XML document to Java classes from which a 
Java object corresponding to the XML document is instantiated). 

In regards to claim 6, Jain teaches: 
• the object-oriented image annotation source code further comprises high-level 
language image annotation source code (Fig. 1, #104 XML DTD, #108 
XML_To_JAVA, #1 10 Java Class, #112 Java Class File, #120 Program, #124 
Java Object), and (p. 1 ,[001 1-0012], see Techniques are disclosed for converting 
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an XML document to an object in an object-oriented language, tliereby providing 
a structured, programmatic, consistent, powerful, and in-memory method for 
accessing the data in the XML document... In one embodiment, a translation tool 
converts an XML DTD associated with the XML document to Java classes from 
which a Java object corresponding to the XML document is instantiated). 

• the object-oriented compiler further comprises a high-level language compiler 
(Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, #112 Java 
Class File, #120 Program, #124 Java Object), and (p. 1, [001 1-0012], see 
Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, 
consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

In regards to claim 16, Jain teaches: 

• the translator being operable to receive a non-procedural image annotation 
template (Fig. 1, note arrow from #104 to #108, and arrow from #102 to #120), 
and (p. 1, [0003], lines 1 - 6, see A Document Type Definition file ("DTD") 
associated with an XML document defines how the mark up tags within the 
document should be interpreted by the application presenting the document. The 
HTML specification that defines how Web pages should be displayed by Web 
browsers is one example of a DTD). 



Application/Control Number: 10/829,417 Page 9 

Art Unit: 2192 

• translate the non-procedural image annotation template to high-level language 
source code (Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, 
#112 Java Class File, #120 Program, #124 Java Object), and (p. 1, [001 1-001 2], 
see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, 
consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

• a parser of the non-procedural image annotation template (Fig. 2, Fig. 3). 

• a translator of the parsed non-procedural image annotation template to the high- 
level language source code (Fig. 1, #104 XML DTD, #108 XML_To_JAVA, #110 
Java Class, #112 Java Class File, #120 Program, #124 Java Object), and (p. 

1 ,[001 1-0012], see Techniques are disclosed for converting an XML document to 
an object in an object-oriented language, thereby providing a structured, 
programmatic, consistent, powerful, and in-memory method for accessing the 
data in the XML document... In one embodiment, a translation tool converts an 
XML DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated). 

In regards to claim 18, Jain teaches: 

• the translator of the parsed non-procedural image annotation template further 
comprises: a writer of high-level language class package source code (Fig. 6, 
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#612 Write the java package statement), and (p. 2, [0028], lines 7-10, see for 
each of the identified nodes in the XML DTD, the translation tool creates a 
corresponding Java class and writes this Java class to a respective file. For 
each of the created Java classes, the translation tool initially generates a 
package statement). 

• a writer of high-level language Import statement source code (p. 2, [0028], lines 
11-13, see the translation tool then generates the standard import statements). 

• a writer of high-level language class declaration source code (Fig. 6, #628 
Generate Java class declaration). 

• a writer of high-level language variable declaration source code (Fig. 6, #632, 
Generate Java class attribute variables). 

• a filler of hash table representing at least one DICOM element of the high-level 
language source code (Fig. 6, #636, Generate Java class constructors). 

In regards to claim 19, Jain teaches: 

• a writer of high-level language source code that constructs a group tree as 
described by the elements of the non-procedural image annotation template (Fig. 
6, #624 Generate Top-Level note import statements, #636 Generate Java class 
constructors, #648 Generate Java common functions). 

• a writer of high-level language source code that loads assigner attributes in an 
ApStyle object and hashes with instances of run-time class declarations (Fig. 2, 
Fig. 3). 
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• a writer of high-level language source code that loads a data structure adapted 
for storage of DICOM elements with all DICOM elements that are required for 
annotation (Fig. 6, #624 Generate Top-Level note import statements, #636 
Generate Java class constructors, and #648 Generate Java common functions). 

• a writer of high-level language source code that loads the data structure adapted 
for tool-tip data with character strings (Fig. 6, #616 Generate Standard Import 
Statements, #638 Generate input stream constructor). 

• a writer of high-level language source code that initializes a layout data structure 
that is designed to hold annotation strings for each quadrant, line, and segment 
(p.2, [0029], lines 8-12, see Finally, the translation tool generates the common 
Java class functions, which are methods to retrieve information about the overall 
messages as defined by the XML DTD. The translation tool also generates the 
appropriate Java syntaxes and comments). 

• a writer of high-level language source code that invalidates all variable contents, 
as one would use if this object was assigned to control annotation of another 
image (Fig. 6, #644 Generate Java to DOM converter method). 

• a writer of high-level language source code that generates comments that 
document a runtime variable updates object; and a writer of Java source code 
that evaluates expressions in order of dependencies (Fig. 6 #642 Generate Java 
validation method). 

In regards to claim 20, Jain teaches: 
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• to translate a non-procedural image annotation template to high-level language 
source code (Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, 
#112 Java Class File, #120 Program, #124 Java Object), and (p. 1, [001 1-001 2], 
see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, 
consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

• parsing the non-procedural image annotation template comprising (Fig. 2, Fig. 3). 

• initializing a parser of the non-procedural image annotation template, the parser 
being compliant with the Simple API for XML standard (p. 1, [0012], lines 1-4, 
see In one embodiment, a translation tool converts an XML DTD associated with 
the XML document to Java classes from which a Java object corresponding to 
the XML document is instantiated), (Fig. 5 #516 Run Program 120 to Instantiate 
java object 124 from java Classes 110, having XML document 102 as in input). 

• parsing an element of the of the non-procedural image annotation template using 
the parser (Fig. 2, Fig. 3). 

• starting an element of the non-procedural image annotation template, ending an 
element of the non-procedural image annotation template, attaching the parsed 
element (Fig. 5, #508 Convert Each of the identified nodes to a respective Java 
class 110 and store these java classes to files 112), (Fig. 4A-P), and (p. 3, 
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[0042], see In step 508, XML_to_Java translation tool 108 converts each of the 
nodes Address, Street, City, State, Zip, and Country identified in step 504 to a 
respective Java class 1 10 Address, Street, City, State, Zip, and Country. 
XML_to_Java translation tool 108 stores each of these classes 1 10 to a 
respective file 1 12 in FIG. 4A to FIG. 4P). An element starter, ender and attacher 
has to exist, otherwise the invention would not be able to convert each node into 
their associated Java code, as depicted in Fig. 4A-P, and the invention would not 
be functional. 

• repeating the starting, parsing, ending and attaching for each element of the non- 
procedural image annotation template, yielding a parsed non-procedural image 
annotation template (Fig. 5, #504 Identify Data nodes in XML DTD, #508 convert 
each of the identified nodes to a respective Java class 1 1 0 and store these Java 
classes to files 112). 

• translating the parsed non-procedural image annotation template to high-level 
language source code (Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java 
Class, #112 Java Class File, #120 Program, #124 Java Object), and (p. 1,[0011- 
0012], see Techniques are disclosed for converting an XML document to an 
object in an object-oriented language, thereby providing a structured, 
programmatic, consistent, powerful, and in-memory method for accessing the 
data in the XML document... In one embodiment, a translation tool converts an 
XML DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated). 
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In regards to claim 21, Jain teaches: 

• the translating of the parsed non-procedural image annotation template further 
comprises: writing a high-level language class package (Fig. 6, #612 Write the 
java package statement), and (p. 2, [0028], lines 7-10, see For each of the 
identified nodes in the XML DTD, the translation tool creates a corresponding 
Java class and writes this Java class to a respective file. For each of the created 
Java classes, the translation tool initially generates a package statement). 

• writing high-level language import statements (p. 2, [0028], lines 11-13, The 
translation tool then generates the standard import statements). 

• writing high-level language class declarations (Fig. 6, #628 Generate Java class 
declaration). 

• writing high-level language variable declarations (Fig. 6, #632, Generate Java 
class attribute variables). 

• filling hash tables representing DICOM elements of the high-level language 
source code (Fig. 6, #636, Generate Java class constructors). 



1 1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1 ) an application for patent, published under section 1 22(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 
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12. Claims 28, 31, 34, 37, 38, 40, 41, 45, 50, 57, 58, 75, 78, 79, 80, and 81 are 
rejected under 35 U.S.C. 102(e) as being anticipated by Yamamoto, US 2005/0198202. 
In regards to claim 28, Yamamoto teaclies: 

• a template repository that is operable to store one or more non-procedural image 
annotation templates (p. 4, [0070], lines 2-13, see upon receiving the request 
previously handled by the step c3, one of sets of viewing information stored on 
the server 10 which corresponds to the selected name, and then transmits the 
selected set of viewing information to the client computer 50. The set of viewing 
information includes: a) document information representing a selected file 
(document) in a format viewable in the Web browser (e.g., a Hyper-Text Mark-up 
Language (HTML) file); b) annotation information representing annotations in a 
format viewable in the Web browser (e.g., an HTML file); and c) a script for 
allocating the annotations to the file (document) (e.g., a JavaScript)). 

• a storer of the one or more non-procedural image annotation templates, operably 
coupled to the template repository (p. 4, [0070], lines 2-13, see upon receiving 
the request previously handled by the step c3, one of sets of viewing information 
stored on the server 10 which corresponds to the selected name, and then 
transmits the selected set of viewing information to the client computer 50. The 
set of viewing information includes: a) document information representing a 
selected file (document) in a format viewable in the Web browser (e.g., a Hyper- 
Text Mark-up Language (HTML) file); b) annotation information representing 
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annotations in a format viewable in the Web browser (e.g., an HTIVIL file); and c) 
a script for allocating the annotations to the file (document) (e.g., a JavaScript)). 

• a selector of the one of the non-procedural image annotation templates, operably 
coupled to the template repository (p. 4, [0070], lines 2-13, see upon receiving 
the request previously handled by the step c3, one of sets of viewing information 
stored on the server 10 which corresponds to the selected name, and then 
transmits the selected set of viewing information to the client computer 50. The 
set of viewing information includes: a) document information representing a 
selected file (document) in a format viewable In the Web browser (e.g., a Hyper- 
Text Mark-up Language (HTML) file); b) annotation information representing 
annotations in a format viewable in the Web browser (e.g., an HTML file); and c) 
a script for allocating the annotations to the file (document) (e.g., a JavaScript)). 

In regards to claim 31, Yamamoto teaches: 

• generate an image annotation executable from a non-procedural image 

annotation template to annotate images, storing the one or more non-procedural 
Image annotation templates in a template repository (p. 4, [0070], lines 2-13, 
see upon receiving the request previously handled by the step c3, one of sets of 
viewing information stored on the server 10 which corresponds to the selected 
name, and then transmits the selected set of viewing Information to the client 
computer 50. The set of viewing information includes: a) document information 
representing a selected file (document) in a format viewable in the Web browser 
(e.g., a Hyper-Text Mark-up Language (HTML) file); b) annotation information 



Application/Control Number: 10/829,417 Page 17 

Art Unit: 2192 

representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) 
(e.g., a JavaScript)). 

• selecting one of the non-procedural image annotation templates in the template 
repository(p. 4, [0070], lines 2-13, see upon receiving the request previously 
handled by the step c3, one of sets of viewing information stored on the server 
10 which corresponds to the selected name, and then transmits the selected set 
of viewing information to the client computer 50. The set of viewing information 
includes: a) document information representing a selected file (document) in a 
format viewable in the Web browser (e.g., a Hyper-Text Mark-up Language 
(HTML) file); b) annotation information representing annotations in a format 
viewable in the Web browser (e.g., an HTML file); and c) a script for allocating 
the annotations to the file (document) (e.g., a JavaScript)). 

In regards to claim 34, Yamamoto teaches: 

• receive the image annotation executable, an image and an image annotation 
object, the image annotation object containing text, the image viewer being 
operable (p. 4, [0070], lines 2-13, see upon receiving the request previously 
handled by the step c3, one of sets of viewing information stored on the server 
10 which corresponds to the selected name, and then transmits the selected set 
of viewing information to the client computer 50. The set of viewing information 
includes: a) document information representing a selected file (document) in a 
format viewable in the Web browser (e.g., a Hyper-Text Mark-up Language 
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(HTML) file); b) annotation information representing annotations in a format 
viewable in the Web browser (e.g., an HTML file); and c) a script for allocating 
the annotations to the file (document) (e.g., a JavaScript)). 

• to execute instructions contained in the image annotation executable and using 
text from the image annotation object (p. 4, [0070], lines 6-13, see The set of 
viewing information includes: a) document information representing a selected 
file (document) in a format viewable in the Web browser (e.g., a Hyper-Text 
Mark-up Language (HTML) file); b) annotation information representing 
annotations in a format viewable in the Web browser (e.g., an HTML file); and c) 
a script for allocating the annotations to the file (document)(e.g., a JavaScript)). 

• the image viewer being operable to generate an annotated image that is 
annotated with the text from the image annotation object Fig. 1 #50 Client Web 
Browser #51 , see Annotation, and Web Browser). 

In regards to claim 37, Yamamoto teaches: 

the image annotation executable further comprises an annotation presentation 
description (p. 4, [0070], lines 6-13, see The set of viewing information includes: a) 
document information representing a selected file (document) in a format viewable in 
the Web browser (e.g., a Hyper-Text Mark-up Language (HTML) file); b) annotation 
information representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) (e.g., a 
JavaScript)). 
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In regards to claim 38, Yamamoto teaches: 

the image annotation object further comprises the image Fig. 10 #2, On completion of 

the displaying a location of a target object to be annotated is specified by JavaScript). 

In regards to claim 40, Yamamoto teaches: 
the image further comprises an unannotated image Fig. 10 #2, On completion of the 
displaying a location of a target object to be annotated is specified by JavaScript). 

In regards to claim 41, Yamamoto teaches: 

the image annotation executable further comprises: an object to select a style class 
object that is appropriate for imaging of a modality; and an instantiated style class object 
(p. 4, [0070], lines 2-13, see upon receiving the request previously handled by the 
step c3, one of sets of viewing information stored on the server 1 0 which corresponds to 
the selected name, and then transmits the selected set of viewing information to the 
client computer 50. The set of viewing information includes: a) document information 
representing a selected file (document) in a format viewable in the Web browser (e.g., a 
Hyper-Text Mark-up Language (HTML) file); b) annotation information representing 
annotations in a format viewable in the Web browser (e.g., an HTML file); and c) a script 
for allocating the annotations to the file (document) (e.g., a JavaScript)). 

In regards to claim 45, Yamamoto teaches: 
• generate and view an annotated medical image, from an image annotation object 
and an annotation presentation description, the image annotation object having 
an image, the annotation presentation description having instructions that are 
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native to a processor that is operably coupled to tlie computer accessible 
medium (p. 4, [0070], lines 2-13, see upon receiving the request previously 
handled by the step c3, one of sets of viewing information stored on the server 
10 which corresponds to the selected name, and then transmits the selected set 
of viewing information to the client computer 50. The set of viewing information 
includes: a) document information representing a selected file (document) in a 
format viewable in the Web browser (e.g., a Hyper-Text Mark-up Language 
(HTML) file); b) annotation information representing annotations in a format 
viewable in the Web browser (e.g., an HTML file); and c) a script for allocating 
the annotations to the file (document) (e.g., a JavaScript)). 

• receiving the annotation presentation description and the image annotation 
object (p. 4, [0070], lines 6-13, see The set of viewing information includes: a) 
document information representing a selected file (document) in a format 
viewable in the Web browser (e.g., a Hyper-Text Mark-up Language (HTML) file); 
b) annotation information representing annotations in a format viewable in the 
Web browser (e.g., an HTML file); and c) a script for allocating the annotations to 
the file (document)(e.g., a JavaScript)). 

• invoking the native instructions contained in the annotation presentation 
description and using text from the image annotation object, to generate and 
view the annotated medical image that is annotated with the text from the image 
annotation object Fig. 1 #50 Client Web Browser #51 , see Annotation, and Web 
Browser). 
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In regards to claim 50, Yamamoto teaches: 

• receiving parsed annotation data and the image from the image annotation object 
through a host image annotation parser (p. 4, [0070], lines 2-13, see upon 
receiving the request previously handled by the step c3, one of sets of viewing 
information stored on the server 10 which corresponds to the selected name, and 
then transmits the selected set of viewing information to the client computer 50. 
The set of viewing information includes: a) document information representing a 
selected file (document) in a format viewable in the Web browser (e.g., a Hyper- 
Text Mark-up Language (HTML) file); b) annotation information representing 
annotations in a format viewable in the Web browser (e.g., an HTML file); and c) 
a script for allocating the annotations to the file (document) (e.g., a JavaScript)). 

• forwarding the image and text to a graphic utilities object that is native to an 
operating system that is running on the processor, whereupon the graphic utilities 
object is to generate and view the annotated image Fig. 1 #50 Client Web 
Browser #51 , see Annotation, and Web Browser). 

In regards to claim 57, Yamamoto teaches: 

a processor; a bus operably coupled to the processor and a computer-accessible 
medium comprising a viewer that is operable to access computer instructions that are 
native to the processor, the computer instructions having been generated by a 
processor on another computer system, the computer-accessible medium being 
operably coupled to the processor through the bus (Fig. 1 , #40 bi-directional arrows 
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from #10 Web server to multiple clients, #50 Clients), (p. 2,[0022], lines 1 - 8, see The 
use of conventional software for an annotation function allows one computer, which 
uses the same type of software for the annotation function that has been used by 
another computer for attaching an annotation to an electronic document, to display the 
electronic document with the attached annotation on the display screen and allows a 
user of the one computer to view the electronic document with the attached annotation), 
and (p. 2, [0024], lines 1 - 5, see an object of the present invention is to provide a 
method for causing a server to provide a plurality of client computers with annotation 
functions, thereby to allow users of the client computers to communicate with each 
other using annotations). 

In regards to claim 58, Yamamoto teaches: 
the viewer further comprises a browser and the computer instructions further comprise 
computer instructions encapsulated in a browser plug-in component Fig. 1 #50 Client 
Web Browser #51 , see Annotation, and Web Browser) 

In regards to claim 75, Yamamoto teaches: 
a processor; and an encapsulation of image annotation computer instructions, the 
computer instructions being native to the processor, the computer instructions being 
generated by a processor on another apparatus (Fig. 1, #40 bi-directional arrows from 
#10 Web server to multiple clients, #50 Clients), (p. 2,[0022], lines 1 - 8, see The use of 
conventional software for an annotation function allows one computer, which uses the 
same type of software for the annotation function that has been used by another 
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computer for attaching an annotation to an electronic document, to display the 
electronic document with the attached annotation on the display screen and allows a 
user of the one computer to view the electronic document with the attached annotation), 
and (p. 2, [0024], lines 1 - 5, see an object of the present invention is to provide a 
method for causing a server to provide a plurality of client computers with annotation 
functions, thereby to allow users of the client computers to communicate with each 
other using annotations). 

In regards to claim 78, Yamamoto teaches: 

• updating a medical imaging system with new annotation calculations, the method 
comprising: receiving an image annotation executable that includes computer 
instructions of the new annotation calculations that are native to a processor of 
the medical imaging system (p. 4, [0070], lines 2-13, see upon receiving the 
request previously handled by the step c3, one of sets of viewing information 
stored on the server 10 which corresponds to the selected name, and then 
transmits the selected set of viewing information to the client computer 50. The 
set of viewing information includes: a) document information representing a 
selected file (document) in a format viewable in the Web browser (e.g., a Hyper- 
Text Mark-up Language (HTML) file); b) annotation information representing 
annotations in a format viewable in the Web browser (e.g., an HTML file); and c) 
a script for allocating the annotations to the file (document) (e.g., a JavaScript)). 

• storing the image annotation executable in a location that is accessible to a 
viewer that is enable to access the image annotation executable (p. 4, [0070], 
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lines 2-13, see upon receiving the request previously handled by the step c3, 
one of sets of viewing information stored on the server 1 0 which corresponds to 
the selected name, and then transmits the selected set of viewing information to 
the client computer 50. The set of viewing information includes: a) document 
information representing a selected file (document) in a format viewable in the 
Web browser (e.g., a Hyper-Text Mark-up Language (HTML) file); b) annotation 
information representing annotations in a format viewable in the Web browser 
(e.g., an HTML file); and c) a script for allocating the annotations to the file 
(document) (e.g., a JavaScript)). 

In regards to claim 79, Yamamoto teaches: 
receiving the image annotation executable from a manufacturer of the medical imaging 
system (p. 4, [0070], lines 2-13, see upon receiving the request previously handled by 
the step c3, one of sets of viewing information stored on the server 10 which 
corresponds to the selected name, and then transmits the selected set of viewing 
information to the client computer 50. The set of viewing Information includes: a) 
document information representing a selected file (document) in a format viewable in 
the Web browser (e.g., a Hyper-Text Mark-up Language (HTML) file); b) annotation 
information representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) (e.g., a 
JavaScript)). 

In regards to claim 80, Yamamoto teaches: 
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the medical imaging system further comprises a computer tomography medical imaging 
system (p. 4, [0070], lines 2-13, see upon receiving the request previously handled by 
the step c3, one of sets of viewing information stored on the server 10 which 
corresponds to the selected name, and then transmits the selected set of viewing 
information to the client computer 50. The set of viewing information includes: a) 
document information representing a selected file (document) in a format viewable in 
the Web browser (e.g., a Hyper-Text Mark-up Language (HTML) file); b) annotation 
information representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) (e.g., a 
JavaScript)). 

In regards to claim 81, Yamamoto teaches: 
the medical imaging system further comprises a magnetic imaging medical imaging 
system (p. 4, [0070], lines 2-13, see upon receiving the request previously handled by 
the step c3, one of sets of viewing information stored on the server 10 which 
corresponds to the selected name, and then transmits the selected set of viewing 
information to the client computer 50. The set of viewing information includes: a) 
document information representing a selected file (document) in a format viewable in 
the Web browser (e.g., a Hyper-Text Mark-up Language (HTML) file); b) annotation 
information representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) (e.g., a 
JavaScript)). 
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Claim Rejections - 35 USC § 103 

1 3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary sl^ill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

14. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

1 5. Claim 7 is rejected under 35 U.S.C. 1 03(a) as being unpatentable over Jain, in 
view of Goede et al. (hereinafter Goede) US 2006/0061595. 

In regards to claim 1, the rejections above are incorporated, respectively. 

In regards to claim 7, Jain doesn't teach: 
the image annotation executable further comprises instructions that are native to a 
processor of a medical imaging system. 

However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
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of image the user is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 

images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

Jain and Goede are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Goede before him or her, to 
modify the system of Jain to include the teachings of Goede, as a method and system 
for visually annotating an image, and accordingly it would enhance the system of Jain, 
which is focused on a translation tool to converts and XML Document Type Definition 
file associated with an XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated, to define the requirements of a 
digital non raster-based annotation architecture and annotating methodology for digital 
images that will serve as a basis for use in a number of exemplary areas: authoring 
tools, presentation programs, and cataloging systems, as suggested by Goede (P. 3, 
[0035], lines 2 - 6). 

16. Claims2, 3, 8, 10, 12-15, 17, 22 - 27, 55, and 59 - 74 are 

rejected under 35 U.S.C. 103(a) as being unpatentable over Jain, in view of Yamamoto. 
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In regards to claims 1, 16, and 20 the rejections above are incorporated, 
respectively. 

In regards to claim 2, Jain doesn't teach: 
the non-procedural image annotation template further comprises a mixture of XML and 
conventional numerical expressions based on C language syntax 
However Yamamoto teaches such use (p. 9, [0148], lines 10-12, see The JX-model 
refers to a model of an XML repository of a Java source program), and (p. 1 1 , [0183], 
lines 1 - 8, see While the system 1 has been described above with respect to the case 
where a document to be annotated is a Java source program, the system 1 , which 
allows information to be shared and exchanged using annotations, may also be 
effectively utilized also for a separate type of a document to be annotated. 
Such a document may be a source program written in another programming 
language, a document related to software, a general document, or the like). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
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Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11, [0183], 
lines 4 -8). 

In regards to claim 3, Jain doesn't teach: 
the image annotation executable further comprises an annotation presentation 
description. 

However Yamamoto teaches such use (p. 4, [0070], lines 6-13, see The set of 
viewing information includes: a) document information representing a selected file 
(document) in a format viewable in the Web browser (e.g., a Hyper-Text Mark-up 
Language (HTML) file); b) annotation information representing annotations in a format 
viewable in the Web browser (e.g., an HTML file); and c) a script for allocating the 
annotations to the file (document) (e.g., a JavaScript)). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
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of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [01 83], 
lines 4 - 8). 

In regards to claim 8, Jain teaches: 

• generate an Image annotation executable from a non-procedural Image 
annotation template to annotate images (Fig. 1, #104 XML DTD, #108 
XML_To_JAVA, #1 10 Java Class, #112 Java Class File, #120 Program, #124 
Java Object), and (p. 1 ,[001 1-0012], see Techniques are disclosed for converting 
an XML document to an object in an object-oriented language, thereby providing 
a structured, programmatic, consistent, powerful, and in-memory method for 
accessing the data in the XML document... In one embodiment, a translation tool 
converts an XML DTD associated with the XML document to Java classes from 
which a Java object corresponding to the XML document is instantiated). 

• translating the non-procedural image annotation template to Image annotation 
source code (Fig. 1, #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, 
#112 Java Class File, #120 Program, #124 Java Object), and (p. 1, [001 1-001 2], 
see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic. 
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consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

• compiling the image annotation source code into an image annotation executable 
(Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, #112 Java 
Class File, #120 Program, #124 Java Object), and (p. 1, [001 1-0012], see 
Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, 
consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

Jain doesn't teach: 

• non-procedural image annotation template comprises non-procedural expression 
of calculations and operations to annotate an image with embedded text. 
However Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of 
the client computer to view a document with an attached annotation on a screen 
of the client computer... The viewing information includes document information, 
annotation information, and a script... The aforementioned annotation information 
represents the annotation in a format that allows the user to view the annotation 
by the Web browser. More particularly, the annotation information includes 
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position information defining a position that the annotation is to be displayed by 
the Web browser with the annotation being attached to the document in 
association with a corresponding one of the plurality of objects... The 
aforementioned script is to be executed by the client computer for allocating the 
annotation to the document... The "annotation" may be achieved by displaying a 
particular comment or note at a particular position on a target document, by 
underlining, emphasizing, highlighting, coloring, or enclosing a particular portion 
of a target document, etc.). 
• the procedural Image annotation source code comprises procedural expression 
of the calculations and operations to annotate an image with embedded text. 
However Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of 
the client computer to view a document with an attached annotation on a screen 
of the client computer... The viewing information Includes document Information, 
annotation information, and a script... The aforementioned annotation information 
represents the annotation in a format that allows the user to view the annotation 
by the Web browser. More particularly, the annotation information includes 
position information defining a position that the annotation is to be displayed by 
the Web browser with the annotation being attached to the document in 
association with a corresponding one of the plurality of objects... The 
aforementioned script is to be executed by the client computer for allocating the 
annotation to the document... The "annotation" may be achieved by displaying a 
particular comment or note at a particular position on a target document, by 
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underlining, empliasizing, liigliligliting, coloring, or enclosing a particular portion 
of a target document, etc.)- 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11 , [01 83], 
lines 4 - 8). 

In regards to claim 10, Jain doesn't teach: 

transferring the image annotation executable to an imaging system. 

However Yamamoto teaches such use (p. 4, [0070], lines 2-13, see upon receiving 

the request previously handled by the step c3, one of sets of viewing information stored 

on the server 10 which corresponds to the selected name, and then transmits the 

selected set of viewing information to the client computer 50. The set of viewing 
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information includes: a) document information representing a selected file (document) in 
a format viewable in the Web browser (e.g., a Hyper-Text Mark-up Language (HTML) 
file); b) annotation information representing annotations in a format viewable in the Web 
browser (e.g., an HTML file); and c) a script for allocating the annotations to the file 
(document) (e.g., a JavaScript)). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 12, Jain doesn't teach: 
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• the non-procedural image annotation template is written in a language that does 
not require procedural operations. 

However Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of 
the client computer to view a document with an attached annotation on a screen 
of the client computer... The viewing information includes document information, 
annotation information, and a script... The aforementioned annotation information 
represents the annotation in a format that allows the user to view the annotation 
by the Web browser. More particularly, the annotation information includes 
position information defining a position that the annotation is to be displayed by 
the Web browser with the annotation being attached to the document in 
association with a corresponding one of the plurality of objects... The 
aforementioned script is to be executed by the client computer for allocating the 
annotation to the document... The "annotation" may be achieved by displaying a 
particular comment or note at a particular position on a target document, by 
underlining, emphasizing, highlighting, coloring, or enclosing a particular portion 
of a target document, etc.). 

• the procedural image annotation source code further comprises calculations and 
operations to annotate an image with embedded text. 

However Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of 
the client computer to view a document with an attached annotation on a screen 
of the client computer... The viewing information includes document information, 
annotation information, and a script... The aforementioned annotation information 
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represents the annotation in a format that allows the user to view the annotation 
by the Web browser. More particularly, the annotation information includes 
position information defining a position that the annotation is to be displayed by 
the Web browser with the annotation being attached to the document in 
association with a corresponding one of the plurality of objects... The 
aforementioned script is to be executed by the client computer for allocating the 
annotation to the document... The "annotation" may be achieved by displaying a 
particular comment or note at a particular position on a target document, by 
underlining, emphasizing, highlighting, coloring, or enclosing a particular portion 
of a target document, etc.). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the Invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
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software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 13, Jain teaches: 

• translate the non-procedural image annotation template to image annotation 
source code (Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, 
#112 Java Class File, #120 Program, #124 Java Object), and (p. 1 ,[001 1-0012], 
see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, 
consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

• compile the image annotation source code into a medical image annotation 
executable, to an instruction set of a processor of an medical imaging system 
(Fig. 1, #104 XML DTD, #108 XML_To_JAVA, #110 Java Class, #112 Java 
Class File, #120 Program, #124 Java Object), and (p. 1, [001 1-0012], see 
Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, 
consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 
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Jain doesn't teach: 

• non-procedural image annotation template comprises non-procedural expression 
of calculations and operations to annotate an image witli embedded text. 
However Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of 
the client computer to view a document with an attached annotation on a screen 
of the client computer... The viewing information includes document information, 
annotation information, and a script... The aforementioned annotation information 
represents the annotation in a format that allows the user to view the annotation 
by the Web browser. More particularly, the annotation information includes 
position information defining a position that the annotation is to be displayed by 
the Web browser with the annotation being attached to the document in 
association with a corresponding one of the plurality of objects... The 
aforementioned script is to be executed by the client computer for allocating the 
annotation to the document... The "annotation" may be achieved by displaying a 
particular comment or note at a particular position on a target document, by 
underlining, emphasizing, highlighting, coloring, or enclosing a particular portion 
of a target document, etc.). 

• the procedural image annotation source code comprises procedural expression 
of the calculations and operations to annotate the image with the embedded text. 
However Yamamoto teaches such use (Fig. 15 #15 a - h, and p. 4, [0075], lines 
1-11, see In FIG. 1 5, an example of a set of variations of the displaying modes 
of annotation is illustrated. Annotation 58a which are displayed in the source- 
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view frame 53b in the normal mode, each indicate a title section 58d, an object 
section 58e, and an "x" section 58f. An annotation 58b, which is displayed in the 
full-content mode, indicates the title section 58d, the object section 58e, the "x" 
section 58f, an author's name 58g, and a text body 58h.An annotation 58c, which 
is displayed in the reducing mode, indicates the object section 58e only. An 
annotation 58i is displayed in the highlighting mode). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [01 83], 
lines 4 - 8). 

In regards to claim 14, Jain doesn't teach: 
transfer the image annotation executable to an imaging system. 
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However Yamamoto teaches such use (p. 4, [0070], lines 2-13, see upon receiving 
the request previously handled by the step c3, one of sets of viewing information stored 
on the server 10 which corresponds to the selected name, and then transmits the 
selected set of viewing information to the client computer 50. The set of viewing 
information includes: a) document information representing a selected file (document) in 
a format viewable in the Web browser (e.g., a Hyper-Text Mark-up Language (HTML) 
file); b) annotation information representing annotations in a format viewable in the Web 
browser (e.g., an HTML file); and c) a script for allocating the annotations to the file 
(document) (e.g., a JavaScript)). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
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lines 4 - 8). 

In regards to claim 15, Jain doesn't teach: 
the non-procedural image annotation template is written in a language that does not 
require procedural operations and wherein the procedural Image annotation source 
code further comprises calculations and operations to annotate an image with 
embedded text. 

However, Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of the 
client computer to view a document with an attached annotation on a screen of the 
client computer... The viewing information includes document information, annotation 
information, and a script... The aforementioned annotation information represents the 
annotation in a format that allows the user to view the annotation by the Web browser. 
More particularly, the annotation information includes position information defining a 
position that the annotation is to be displayed by the Web browser with the annotation 
being attached to the document in association with a corresponding one of the plurality 
of objects... The aforementioned script is to be executed by the client computer for 
allocating the annotation to the document... The "annotation" may be achieved by 
displaying a particular comment or note at a particular position on a target document, by 
underlining, emphasizing, highlighting, coloring, or enclosing a particular portion of a 
target document, etc.). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 
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Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 17, Jain teaches: 

• an initiator of a parser of the non-procedural image annotation template (p. 1 , 
[0012], lines 1- 4, see In one embodiment, a translation tool converts an XML 
DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated), (Fig. 5 #516 Run 
Program 120 to Instantiate java object 124 from java Classes 110, having XML 
document 102 as in input). 

• an element parser (Fig. 2, Fig. 3). 

• an element starter, an element ender, and an element attacher (Fig. 5, #508 
Convert Each of the identified nodes to a respective Java class 1 1 0 and store 



Application/Control Number: 10/829,417 Page 43 

Art Unit: 2192 

these java classes to files 112), (Fig. 4A-P), and (p. 3, [0042], see In step 508, 
XML_to_Java translation tool 108 converts each of the nodes Address, Street, 
City, State, Zip, and Country identified in step 504 to a respective Java class 110 
Address, Street, City, State, Zip, and Country. XML_to_Java translation tool 108 
stores each of these classes 1 1 0 to a respective file 1 1 2 in FIG. 4A to FIG. 4P). 
An element starter, ender and attacher has to exist, otherwise the invention 
would not be able to convert each node into their associated java code, as 
depicted in Fig. 4A-P, and the invention would not be functional. 
Jain doesn't teach: 
• the parser being compliant with the Simple API for XML standard. 

However, Yamamoto teaches such use (p. 9, [0148], lines 10-12, see The JX- 
model refers to a model of an XML repository of a Java source program), and (p. 
1 1 , [0183], lines 1 - 8, see While the system 1 has been described above with 
respect to the case where a document to be annotated is a Java source program, 
the system 1, which allows information to be shared and exchanged using 
annotations, may also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written 
in another programming language, a document related to software, a general 
document, or the like). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
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ordinary sl<ill in tlie art, having the teaching of Jain, and Yamannoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [01 83], 
lines 4 - 8). 

In regards to claim 22, Jain doesn't teach: 
the non-procedural image annotation template further comprises a mixture of XML and 
conventional numerical expressions based on C language syntax. 
However, Yamamoto teaches such use (p. 9, [0148], lines 10-12, see The JX-model 
refers to a model of an XML repository of a Java source program), and (p. 1 1 , [01 83], 
lines 1 - 8, see While the system 1 has been described above with respect to the case 
where a document to be annotated is a Java source program, the system 1 , which 
allows information to be shared and exchanged using annotations, may also be 
effectively utilized also for a separate type of a document to be annotated. Such a 
document may be a source program written in another programming language, a 
document related to software, a general document, or the like). 
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Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11, [0183], 
lines 4 - 8). 

In regards to claim 23, Jain teaches: 
• to translate a non-procedural image annotation template to high-level language 
source code (Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, 
#112 Java Class File, #120 Program, #124 Java Object), and (p. 1, [001 1-001 2], 
see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, 
consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
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associated witli tlie XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

• parsing the non-procedural image annotation template comprising (Fig. 2, Fig. 3). 

• initializing a parser of the non-procedural image annotation template (p. 1 , 
[0012], lines 1- 4, see In one embodiment, a translation tool converts an XML 
DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated), (Fig. 5 #516 Run 
Program 120 to Instantiate java object 124 from java Classes 110, having XML 
document 102 as in input). 

• parsing an element of the of the non-procedural image annotation template using 
the parser (Fig. 2, Fig. 3). 

• starting an element of the non-procedural image annotation template, ending an 
element of the non-procedural image annotation template, attaching the parsed 
element (Fig. 5, #508 Convert Each of the identified nodes to a respective Java 
class 1 1 0 and store these java classes to files 1 1 2), (Fig. 4A-P), and (p. 3, 
[0042], see In step 508, XML_to_Java translation tool 108 converts each of the 
nodes Address, Street, City, State, Zip, and Country identified in step 504 to a 
respective Java class 1 10 Address, Street, City, State, Zip, and Country. 
XML_to_Java translation tool 108 stores each of these classes 1 10 to a 
respective file 1 12 in FIG. 4A to FIG. 4P). An element starter, ender and attacher 
has to exist, otherwise the invention would not be able to convert each node into 
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their associated java code, as depicted in Fig. 4A-P, and the invention would not 
be functional. 

• repeating the starting, parsing, ending and attaching for each element of the non- 
procedural image annotation template, yielding a parsed non-procedural image 
annotation template, the translating further comprising (Fig. 5, #504 Identify Data 
nodes in XML DTD, #508 convert each of the identified nodes to a respective 
java class 1 1 0 and store these java classes to files 1 1 2). 

• translating the parsed non-procedural image annotation template to high-level 
language source code (Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java 
Class, #112 Java Class File, #120 Program, #124 Java Object), and (p. 1,[0011- 
0012], see Techniques are disclosed for converting an XML document to an 
object in an object-oriented language, thereby providing a structured, 
programmatic, consistent, powerful, and In-memory method for accessing the 
data in the XML document... In one embodiment, a translation tool converts an 
XML DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated). 

Jain doesn't teach: 

• the parser being compliant with the Simple API for XML standard. 

However Yamamoto teaches such use (p. 9, [0148], lines 10-12, see The JX- 
model refers to a model of an XML repository of a Java source program), and (p. 
1 1 , [0183], lines 1 - 8, see While the system 1 has been described above with 
respect to the case where a document to be annotated is a Java source program. 
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the system 1 , which allows information to be shared and exchanged using 
annotations, may also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written 
In another programming language, a document related to software, a general 

document, or the like). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and Images. 

Therefore, at the time of the Invention, It would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to Include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly It would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document Is Instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 -8). 

In regards to claim 24, Jain teaches: 
• the translating of the parsed non-procedural Image annotation template further 
comprises: writing a high-level language class package (Fig. 6, #612 Write the 
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Java package statement), and (p. 2, [0028], lines 7-10, see For each of the 
identified nodes in the XML DTD, the translation tool creates a corresponding 
Java class and writes this Java class to a respective file. For each of the created 
Java classes, the translation tool initially generates a package statement). 

• writing high-level language import statements (p. 2, [0028], lines 11 - 13, The 
translation tool then generates the standard import statements). 

• writing high-level language class declarations (Fig. 6, #628 Generate Java class 
declarations). 

• writing high-level language variable declarations (Fig. 6, #628 Generate Java 
class declarations). 

• filling hash tables representing DICOM elements of the high-level language 
source code (Fig. 6, #636, Generate Java class constructors). 

In regards to claim 25, Jain doesn't teach: 
the non-procedural image annotation template further comprises a mixture of XML and 

conventional numerical expressions based on C language syntax. 
However Yamamoto teaches such use (p. 9, [0148], lines 10-12, see The JX-model 
refers to a model of an XML repository of a Java source program), and (p. 1 1 , [01 83], 
lines 1 - 8, see While the system 1 has been described above with respect to the case 
where a document to be annotated is a Java source program, the system 1 , which 
allows information to be shared and exchanged using annotations, may also be 
effectively utilized also for a separate type of a document to be annotated. 
Such a document may be a source program written in another programming 
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language, a document related to software, a general document, or the like). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11, [0183], 
lines 4 - 8). 

In regards to claim 26, Jain teaches: 

• parse the non-procedural image annotation template comprising (Fig. 2, Fig. 3). 

• parse an element of the of the non-procedural image annotation template using 
the parser (Fig. 2, Fig. 3). 

• start an element of the non-procedural image annotation template, end an 
element of the non-procedural image annotation template, attach the parsed 
element, repeat the starting, parsing, ending and attaching for each element of 
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the non-procedural image annotation template, yielding a parsed non-procedural 
image annotation template, the high-level language based system further 
comprising (Fig. 5, #508 Convert Each of the identified nodes to a respective 
Java class 110 and store these java classes to files 112), (Fig. 4A-P), and (p. 3, 
[0042], see In step 508, XML to Java translation tool 108 converts each of the 
nodes Address, Street, City, State, Zip, and Country identified in step 504 to a 
respective Java class 1 10 Address, Street, City, State, Zip, and Country. 
XML_to_Java translation tool 108 stores each of these classes 1 10 to a 
respective file 1 12 in FIG. 4A to FIG. 4P). An element starter, ender and attacher 
has to exist, otherwise the invention would not be able to convert each node into 
their associated java code, as depicted in Fig. 4A-P, and the invention would not 
be functional. 

• translate comprising: write a high-level language class package (Fig. 1 , #1 04 
XML DTD, #108 XML_To_JAVA, #110 Java Class, #112 Java Class File, #120 
Program, #124 Java Object), and (p. 1, [001 1-0012], see Techniques are 
disclosed for converting an XML document to an object in an object-oriented 
language, thereby providing a structured, programmatic, consistent, powerful, 
and in-memory method for accessing the data in the XML document... In one 
embodiment, a translation tool converts an XML DTD associated with the XML 
document to Java classes from which a Java object corresponding to the XML 
document is instantiated). 
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• write liigh-level language import statements (p. 2, [0028], lines 11-13, The 
translation tool then generates the standard import statements). 

• write high-level language class declarations (Fig. 6, #628 Generate Java class 
declarations). 

• means for write high-level language variable declarations (Fig. 6, #632, Generate 
Java class attribute variables). 

• fill hash tables representing DICOM elements of high-level language source code 
(Fig. 6, #636, Generate Java class constructors). 

Jain doesn't teach: 

• initialize a parser of the non-procedural image annotation template, the parser 
being compliant with the Simple API for XML standard. 

However Yamamoto teaches such use (p. 9, [0148], lines 10-12, see The JX- 
model refers to a model of an XML repository of a Java source program), and (p. 
1 1 , [0183], lines 1 - 8, see While the system 1 has been described above with 
respect to the case where a document to be annotated is a Java source program, 
the system 1, which allows information to be shared and exchanged using 
annotations, may also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written 
in another programming language, a document related to software, a general 
document, or the like). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 
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Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 27, Jain doesn't teach: 
the non-procedural image annotation template further comprises a mixture of XML and 
conventional numerical expressions based on C language syntax. 
However Yamamoto teaches such use (p. 9, [0148], lines 10-12, see The JX-model 
refers to a model of an XML repository of a Java source program), and (p. 1 1 , [0183], 
lines 1 - 8, see While the system 1 has been described above with respect to the case 
where a document to be annotated is a Java source program, the system 1 , which 
allows information to be shared and exchanged using annotations, may also be 
effectively utilized also for a separate type of a document to be annotated. 
Such a document may be a source program written in another programming 
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language, a document related to software, a general document, or the like). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11, [0183], 
lines 4 - 8). 

In regards to claim 55, Jain teaches: 

• the annotation object conforms to the Digital Imaging and Communications in 
Medicine standard and has an image (Fig. 6, #616 Generate Standard Import 
Statements, #638 Generate input stream constructor). 

• high-level language based means for receiving the annotation presentation 
description and the image annotation object, the image annotation object 
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containing text (Fig. 6, # 616 Generate Standard Import Statements, # 638 
Generate input stream constructor). 
Jain doesn't teach: 

• the annotation presentation description further comprises an annotation 
presentation description compiled from a non-procedural image annotation 
template and has instructions that are native to a processor. 

However Yamamoto teaches such use (p. 4, [0070], lines 6-13, see The set of 
viewing information includes: a) document information representing a selected 
file (document) in a format viewable in the Web browser (e.g., a Hyper-Text 
Mark-up Language (HTML) file); b) annotation information representing 
annotations in a format viewable in the Web browser (e.g., an HTML file); and c) 
a script for allocating the annotations to the file (document)(e.g., a JavaScript)). 

• high-level language means for invoking the native instructions contained in the 
annotation presentation description and using text from the image annotation 
object, to generate and view the annotated medical image that is annotated with 
the text from the image annotation object. 

However Yamamoto teaches such use (p. 4, [0070], lines 2-13, see upon 
receiving the request previously handled by the step c3, one of sets of viewing 
information stored on the server 10 which corresponds to the selected name, and 
then transmits the selected set of viewing information to the client computer 50. 
The set of viewing information includes: a) document information representing a 
selected file (document) in a format viewable in the Web browser (e.g., a Hyper- 
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Text Mark-up Language (HTML) file); b) annotation information representing 
annotations in a format viewable in the Web browser (e.g., an HTML file); and c) 
a script for allocating the annotations to the file (document) (e.g., a JavaScript)). 
Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 -8). 

In regards to claim 59, Jain teaches: 
• a viewer that is operable to access: objects that conform to the Digital Imaging 
and Communications in Medicine standard, the objects comprising an image and 
an annotation presentation description (Fig. 6, #616 Generate Standard Import 
Statements, #638 Generate input stream constructor). 
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Jain doesn't teach: 

• computer instructions that are native to the processor, the computer instructions 
having been generated by a processor on another system, the computer- 
accessible medium being operably coupled to the processor through the bus. 

However Yamamoto teaches such use: 

(Fig. 1, #40 bi-directional arrows from #10 Web server to multiple clients, #50 
Clients), (p. 2, [0022], lines 1 - 8, see The use of conventional software for an 
annotation function allows one computer, which uses the same type of software 
for the annotation function that has been used by another computer for attaching 
an annotation to an electronic document, to display the electronic document with 
the attached annotation on the display screen and allows a user of the one 
computer to view the electronic document with the attached annotation), and (p. 
2, [0024], lines 1 - 5, see an object of the present invention is to provide a 
method for causing a server to provide a plurality of client computers with 
annotation functions, thereby to allow users of the client computers to 
communicate with each other using annotations). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
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object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written In another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 60, Jain doesn't teach: 

the viewer further comprises a browser and the computer instructions further comprise 
computer Instructions encapsulated in a browser plug-in component. 
However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51 , see 
Annotation, and Web Browser). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
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object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 61, Jain doesn't teach: 
the computer instructions further comprise computer instructions encapsulated in a 

dynamic link library. 

However Yamamoto teaches such use (p. 7, [0117], lines 3-13, see JSP includes any 
of a number of Java technologies that are directed to servers and that enable the 
dynamic generation of Web pages. "Servlet" is a technology for implementing software 
components that perform processing on a Web server upon request of a client (Web 
browser). Dynamic HTML (DHTML) (e.g., HTML, JavaScript, Cascading Style Sheet 
(CSS), or any other technology for adding interactivity to Web pages), which is used for 
allowing output of the server 10 to the client computer 50, provides the annotation 
functions at the client). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
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computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 62, Jain teaches: 
an encapsulation of image annotation native computer instructions (Fig. 2, Fig. 3). 
Jain doesn't teach: 

a viewer that Is operable to access the encapsulated image annotation computer 
Instructions. 

However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51 , see 
Annotation, and Web Browser). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
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object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written In another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 63, Jain doesn't teach: 
the encapsulated image annotation computer instructions further comprise arithmetic 
calculations and special string operations for annotation that are native to a processor 
that Is operably coupled to the computer-accessible medium 
However Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of the 
client computer to view a document with an attached annotation on a screen of the 
client computer... The viewing Information includes document Information, annotation 
Information, and a script... The aforementioned annotation Information represents the 
annotation in a format that allows the user to view the annotation by the Web browser. 
More particularly, the annotation information includes position information defining a 
position that the annotation Is to be displayed by the Web browser with the annotation 
being attached to the document in association with a corresponding 
one of the plurality of objects... The aforementioned script is to be executed by the client 
computer for allocating the annotation to the document... The "annotation" may be 
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achieved by displaying a particular comment or note at a particular position on a target 
document, by underlining, emphasizing, highlighting, coloring, or enclosing a particular 
portion of a target document, etc..)- 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 64, Jain teaches: 

• the executable instructions being contained in an image annotation 

executable(Fig. 1, #104 XML DTD, #108 XML_To_JAVA, #1 10 Java Class, #112 
Java Class File, #120 Program, #124 Java Object), and (p. 1, [001 1-0012], see 
Techniques are disclosed for converting an XML document to an object in an 
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object-oriented language, thereby providing a structured, programmatic, 
consistent, powerful, and in-memory method for accessing the data in the XML 
document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

• generating an annotated image that is annotated with the text from the image 
annotation object(Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #1 10 Java 
Class, #112 Java Class File, #120 Program, #124 Java Object), and (p. 1,[0011- 
0012], see Techniques are disclosed for converting an XML document to an 
object in an object-oriented language, thereby providing a structured, 
programmatic, consistent, powerful, and in-memory method for accessing the 
data in the XML document... In one embodiment, a translation tool converts an 
XML DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated). 

• operands to the native computer instructions include text. (Fig. 1 , #1 04 XML 
DTD, #108 XML_To_JAVA, #1 10 Java Class, #112 Java Class File, #120 
Program, #124 Java Object), and (p. 1, [001 1-0012], see Techniques are 
disclosed for converting an XML document to an object in an object-oriented 
language, thereby providing a structured, programmatic, consistent, powerful, 
and in-memory method for accessing the data in the XML document... In one 
embodiment, a translation tool converts an XML DTD associated with the XML 
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document to Java classes from which a Java object corresponding to the XML 
document is instantiated). It's obvious that documents contain textual data. 
Jain doesn't teach: 
• invoking executable instructions that are native to the processor. 

However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51 , see 
Annotation, and Web Browser). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the Invention, it would have been obvious to one of 
ordinary skill In the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly It would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written In another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [01 83], 
lines 4 - 8). 

In regards to claim 65, Jain doesn't teach: 
the executable instructions further comprise executable instructions capable of directing 
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the processor to perform displaying the annotated image on a visual display in a 
browser. 

However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51 , see 
Annotation and Web Browser). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 66, Jain teaches: 
the image annotation object further comprises an object that is encoded according to a 
standard that defines data elements in object-oriented terms, each object having a 
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unique tag, nanne, characteristics and semantics(Fig. 1, #104 XIVIL DTD, #108 
XML_To_JAVA, #1 10 Java Class, #1 12 Java Class File, #120 Program, #124 Java 
Object), and (p. 1, [001 1-0012], see Techniques are disclosed for converting an XML 
document to an object in an object-oriented language, thereby providing a structured, 
programmatic, consistent, powerful, and in-memory method for accessing the data In 
the XML document... In one embodiment, a translation tool converts an XML DTD 
associated with the XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated). 

In regards to claim 67, Jain doesn't teach: 
the original image further comprises an original unannotated medical image. 
However Yamamoto teaches such use Fig. 10 #2, On completion of the displaying a 
location of a target object to be annotated is specified by JavaScript). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill In the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly It would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 



Application/Control Number: 10/829,417 
Art Unit: 2192 



Page 67 



also for a separate type of a document to be annotated. Such a document may be a 

source program written in anotlier programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11 , [01 83], 
lines 4 - 8). 

In regards to claim 68, Jain doesn't teach: 
the original image further comprises an original image contained with the image 
annotation object. 

However Yamamoto teaches such use Fig. 10 #2, On completion of the displaying a 
location of a target object to be annotated is specified by JavaScript). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
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software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 69, Jain doesn't teach: 
the image annotation executable further comprises an annotation presentation 
description. 

However Yamamoto teaches such use (p. 4, [0070], lines 6-13, see The set of 
viewing information includes: a) document information representing a selected file 
(document) in a format viewable in the Web browser (e.g., a Hyper-Text Mark-up 
Language (HTML) file); b) annotation information representing annotations in a format 
viewable in the Web browser (e.g., an HTML file); and c) a script for allocating the 
annotations to the file (document) (e.g., a JavaScript)). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
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source program written in anotlier programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11, [0183], 

lines 4 -8). 

In regards to claim 70, Jain teaches: 

• invoking executable instructions that are native to the processor, the executable 
instructions being contained in the annotation presentation description, operands 
to the native computer instructions including text, the image annotation object 
being encoded according to a standard that defines data elements in object- 
oriented terms, the image annotation object having a unique tag, name, 
characteristics and semantics (Fig. 1, #104 XML DTD, #108 XML_To_JAVA, 
#110 Java Class, #112 Java Class File, #120 Program, #124 Java Object), and 
(p. 1 ,[0011 -001 2], see Techniques are disclosed for converting an XML 
document to an object in an object-oriented language, thereby providing a 
structured, programmatic, consistent, powerful, and in-memory method for 
accessing the data in the XML document... In one embodiment, a translation tool 
converts an XML DTD associated with the XML document to Java classes from 
which a Java object corresponding to the XML document is instantiated). 

Jain doesn't teach: 

• annotating an original medical image with the text from the image annotation 
object. 
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However Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of 
the client computer to view a document with an attached annotation on a screen 
of the client computer... The viewing information includes document information, 
annotation information, and a script... The aforementioned annotation information 
represents the annotation in a format that allows the user to view the annotation 
by the Web browser. More particularly, the annotation information includes 
position information defining a position that the annotation is to be displayed by 
the Web browser with the annotation being attached to the document in 
association with a corresponding one of the plurality of objects... The 
aforementioned script is to be executed by the client computer for allocating the 
annotation to the document... The "annotation" may be achieved by displaying a 
particular comment or note at a particular position on a target document, by 
underlining, emphasizing, highlighting, coloring, or enclosing a particular portion 
of a target document, etc.). 
• displaying the annotated image on a visual display. 

However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51 , see 
Annotation, and Web Browser). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
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computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 

In regards to claim 71, Jain doesn't teach: 
the executable Instructions further comprise annotation calculations and operations. 
However Yamamoto teaches such use (p. 2, [0026 - 0030], see allows a user of the 
client computer to view a document with an attached annotation on a screen of the 
client computer... The viewing information includes document information, annotation 
Information, and a script... The aforementioned annotation Information represents the 
annotation In a format that allows the user to view the annotation by the Web browser. 
More particularly, the annotation information includes position information defining a 
position that the annotation is to be displayed by the Web browser with the annotation 
being attached to the document In association with a corresponding 
one of the plurality of objects... The aforementioned script is to be executed by the client 
computer for allocating the annotation to the document... The "annotation" may be 
achieved by displaying a particular comment or note at a particular position on a target 
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document, by underlining, empliasizing, highlighting, coloring, or enclosing a particular 
portion of a target document, etc.). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [01 83], 
lines 4 - 8). 

In regards to claim 72, Jain doesn't teach: 
the displaying further comprises a displaying of the annotated image in a browser. 
However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51 , see 
Annotation, and Web Browser). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 
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Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11, [0183], 
lines 4 - 8). 

In regards to claim 73, Jain doesn't teach: 
the processor further comprises a processor of a medical imaging device. 
However Yamamoto teaches such use (p. 4, [0070], lines 2-13, see upon receiving 
the request previously handled by the step c3, one of sets of viewing information stored 
on the server 10 which corresponds to the selected name, and then transmits the 
selected set of viewing information to the client computer 50. The set of viewing 
information includes: a) document information representing a selected file (document) in 
a format viewable in the Web browser (e.g., a Hyper-Text Mark-up Language (HTML) 
file); b) annotation information representing annotations in a format viewable in the Web 
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browser (e.g., an HTML file); and c) a script for allocating the annotations to the file 
(document) (e.g., a JavaScript)). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [01 83], 
lines 4 - 8). 

In regards to claim 74, Jain doesn't teach: 
the original image further comprises an original image contained with the image 
annotation object. 

However Yamamoto teaches such use Fig. 10 #2, On completion of the displaying a 
location of a target object to be annotated is specified by JavaScript). 

Jain and Yamamoto are analogous art because they are from the same field of 
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endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.11 , [01 83], 
lines 4 - 8). 

1 7. Claims 29, 30, 32, 33, 35, 42, 43, 44, 48, 49, 76, and 77 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Yamamoto, in view of Goede. 

In regards to claims 28, 31, 34, 41, and 45 the rejections above are 
incorporated, accordingly. 

In regards to claim 29, Yamamoto doesn't teach: 
the one or more non-procedural image annotation templates further comprises a 
computed tomography non-procedural image annotation template. 
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However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user Is requesting, i.e., TIF, JPEG,DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information In the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
Images, may be stored In a structured vector representation alongside Image 
Information In a single, non-volatile and portable file or in a separate file from the 
image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and Images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an Image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document. 
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or the like, as suggested by Yamamoto (P.1 1 , [0183], lines 4 - 8). 

In regards to claim 30, Jain doesn't teach: 
the one or more non-procedural image annotation templates further comprises a 
magnetic-resonance non-procedural image annotation template. 
However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG,DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
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annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document, 
or the like, as suggested by Yamamoto (P.1 1 , [0183], lines 4 - 8). 

In regards to claim 32, Yamamoto doesn't teach: 
the one or more non-procedural image annotation templates further comprises a 
computed tomography non-procedural image annotation template. 
However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG,DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 
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Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document, 
or the like, as suggested by Yamamoto (P.1 1 , [01 83], lines 4 - 8). 

In regards to claim 33, Yamamoto doesn't teach: 
the one or more non-procedural image annotation templates further comprises a 
magnetic-resonance non-procedural image annotation template. 
However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data. ..Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
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information in a single, non-volatile and portable file or in a separate file from the 
image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document, 
or the like, as suggested by Yamamoto (P.1 1 , [01 83], lines 4 - 8). 

In regards to claim 35, Yamamoto doesn't teach: 
the instructions further comprise computer instructions that are native to a processor, 
the processor being operably coupled through a bus to the computer-accessible 
medium. 

However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
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of image the user is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 

images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document, 
or the like, as suggested by Yamamoto (P.1 1 , [01 83], lines 4 - 8). 

In regards to claim 42, Yamamoto doesn't teach: 
the modality is selected from a group consisting of magnetic resonance, computed 
tomography. X-ray, ultrasound and positron emission tomography. 
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However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user Is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information In the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
Images, may be stored In a structured vector representation alongside Image 
Information In a single, non-volatile and portable file or in a separate file from the 
image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and Images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an Image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document. 
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or the like, as suggested by Yamamoto (P.1 1 , [0183], lines 4 - 8). 

In regards to claim 43, Yamamoto teaches: 

• an object to receive parsed annotation data and the image from the image 
annotation object through a host image annotation parser (p. 4, [0070], lines 2 - 
13, see upon receiving the request previously handled by the step c3, one of sets 
of viewing information stored on the server 10 which corresponds to the selected 
name, and then transmits the selected set of viewing information to the client 
computer 50. The set of viewing information includes: a) document information 
representing a selected file (document) in a format viewable in the Web browser 
(e.g., a Hyper-Text Mark-up Language (HTML) file); b) annotation information 
representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) 
(e.g., a JavaScript)). 

• to forward the image and text to the style class object that is appropriate for 
imaging of a modality (p. 4, [0070], lines 2-13, see upon receiving the request 
previously handled by the step c3, one of sets of viewing information stored on 
the server 10 which corresponds to the selected name, and then transmits the 
selected set of viewing information to the client computer 50. The set of viewing 
information includes: a) document information representing a selected file 
(document) in a format viewable in the Web browser (e.g., a Hyper-Text Mark-up 
Language (HTML) file); b) annotation information representing annotations in a 
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format viewable in the Web browser (e.g., an HTML file); and c) a script for 
allocating the annotations to the file (document) (e.g., a JavaScript)). 
Yamamoto doesn't teach: 
• an object to invoke one or more methods in the object that selects a style class 

object that is appropriate for imaging of a modality 

However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see 
FIG. 6 is a diagram showing the data flow carried out in accordance with an 
illustrative embodiment of the present invention. The first step is to extract the 
image data... Digital information can also consist of color settings, grayscale 
levels, image pixel dimensions, or the type of image the user is requesting, i.e., 
TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9-13, see The metadata may 
also include patient information in the case of medical images), (abstract, lines 1 
- 6, see A method and system for visually annotating an image. Annotations and 
notes to images, such as digital medical and healthcare images, may be stored 
in a structured vector representation alongside image information in a single, 
non-volatile and portable file or in a separate file from the image). 
Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an image, and accordingly it would 
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enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document, 
or the like, as suggested by Yamamoto (P.1 1 , [01 83], lines 4 - 8). 

In regards to claim 44, Yamamoto teaches: 

• a method to forward the image and text to a host text drawer in the viewer. 
Fig. 10 #2, On completion of the displaying a location of a target object to be 
annotated is specified by JavaScript). 

• a method to forward the Image and text to a graphic utilities object that Is native 
to an operating system that is running on a processor that is operably coupled to 
the computer-accessible medium, whereupon the graphic utilities object is to 
generate the annotated image Fig. 1 #50 Client Web Browser #51 , see 
Annotation, and Web Browser). 

In regards to claim 48, Yamamoto doesn't teach: 
the annotation presentation description further comprises executable Instructions 
capable of directing the processor to perform: selecting a style class object that Is 
appropriate for imaging of a modality; and instantiating the selected style class object. 
However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
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of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document, 
or the like, as suggested by Yamamoto (P.1 1 , [0183], lines 4 - 8). 

In regards to claim 49, Yamamoto doesn't teach: 
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the modality is selected from a group consisting of magnetic resonance, computed 
tomography, X-ray, ultrasound and positron emission tomography. 
However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG, DiCOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

In regards to claim 76, Yamamoto teaches: 
forwarding the image annotation executable through the Internet to the medical imaging 

system (Fig. 1 , #40 bi-directional arrows from server to clients, #50 Clients, #10 Web 
server), and (p. 4, [0063], lines 5-9, see a connection between the client computer 50 
and the server 10 via the network 40 would allow a user of the client computer 50 to 
access and utilize a Web site (for sending Web pages) built on the server 10). 
Yamamoto doesn't teach: 
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generating on a development system an image annotation executable that includes 
computer instructions that are native to a processor of the medical imaging system. 
However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data. ..Digital information 
can also consist of color settings, grayscale levels, Image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
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document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document, 
or the like, as suggested by Yamamoto (P.1 1 , [0183], lines 4 - 8). 

In regards to claim 77, Yamamoto teaches: 
an image annotation executable that package is a form selected from the group 
consisting of a browser-plug-in and a dynamic link library (p. 7, [0117], lines 3-13, see 
JSP includes any of a number of Java technologies that are directed to servers and that 
enable the dynamic generation of Web pages. "Servlet" is a technology for 
implementing software components that perform processing on a Web server upon 
request of a client (Web browser). Dynamic HTML (DHTML) (e.g., HTML, JavaScript, 
Cascading Style Sheet (CSS), or any other technology for adding interactivity to Web 
pages), which is used for allowing output of the server 10 to the client computer 50, 
provides the annotation functions at the client). 

1 8. Claims 36, 39, 46, and 47 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Yamamoto, in view of Jain. 

In regards to claims 34 and 45 the rejections above are incorporated, 
respectively. 

In regards to claim 36, Yamamoto doesn't teach: 
the image annotation executable further comprises an image annotation executable that 
is compiled from a non-procedural image annotation template. 
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However Jain teaches such use (Fig. 1, #104 XML DTD, #108 XML_To_JAVA, #110 
Java Class, #112 Java Class File, #120 Program, #124 Java Object), and (p. 1 , [001 1- 
0012], see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, consistent, 
powerful, and in-memory method for accessing the data in the XML document... In one 
embodiment, a translation tool converts an XML DTD associated with the XML 
document to Java classes from which a Java object corresponding to the XML 
document is instantiated). 

Yamamoto and Jain are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Jain before him or 
her, to modify the system of Yamamoto to include the teachings of Jain, as a 
translation tool to converts and XML Document Type Definition file associated with an 
XML document to Java classes from which a Java object corresponding to the XML 
document is instantiated, and accordingly it would enhance the system of Yamamoto, 
which is focused on providing client computers with annotation functions enabling users 
of the client computers to view object-based documents with annotations, to also be 
effectively utilized also for a separate type of a document to be annotated. Such a 
document may be a source program written in another programming language, a 
document related to software, a general document, or the like, as suggested by 
Yamamoto (P.11, [0183], lines 4 - 8). 
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In regards to claim 39, Yamamoto doesn't teach: 

the image annotation object further comprises an image annotation object that conforms 
to standard that defines data elements in object-oriented terms, each object having a 
unique tag, name, characteristics and semantics. 

However Jain teaches such use (Fig. 1, #104 XML DTD, #108 XML_To_JAVA, #110 
Java Class, #112 Java Class File, #120 Program, #124 Java Object), and (p. 1, [0011- 
0012], see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, consistent, 
powerful, and in-memory method for accessing the data in the XML document... In one 
embodiment, a translation tool converts an XML DTD associated with the XML 
document to Java classes from which a Java object corresponding to the XML 
document is instantiated). 

Yamamoto and Jain are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Jain before him or 
her, to modify the system of Yamamoto to include the teachings of Jain, as a 
translation tool to converts and XML Document Type Definition file associated with an 
XML document to Java classes from which a Java object corresponding to the XML 
document is instantiated, and accordingly it would enhance the system of Yamamoto, 
which is focused on providing client computers with annotation functions enabling users 
of the client computers to view object-based documents with annotations, to also be 
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effectively utilized also for a separate type of a document to be annotated. Such a 
document may be a source program written in another programming language, a 
document related to software, a general document, or the like, as suggested by 
Yamamoto(P.11, [0183], lines 4 -8). 

In regards to claim 46, Yamamoto doesn't teach: 
the annotation presentation description further comprises an annotation presentation 
description that is compiled from a non-procedural image annotation template. 
However Jain teaches such use (Fig. 1, #104 XML DTD, #108 XML_To_JAVA, #110 
Java Class, #112 Java Class File, #120 Program, #124 Java Object), and (p. 1, [0011- 
0012], see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, consistent, 
powerful, and in-memory method for accessing the data in the XML document... In one 
embodiment, a translation tool converts an XML DTD associated with the XML 
document to Java classes from which a Java object corresponding to the XML 
document is instantiated). 

Yamamoto and Jain are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Jain before him or 
her, to modify the system of Yamamoto to include the teachings of Jain, as a 
translation tool to converts and XML Document Type Definition file associated with an 
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XML document to Java classes from which a Java object corresponding to the XML 
document is instantiated, and accordingly it would enhance the system of Yamamoto, 
which is focused on providing client computers with annotation functions enabling users 
of the client computers to view object-based documents with annotations, to also be 
effectively utilized also for a separate type of a document to be annotated. Such a 
document may be a source program written in another programming language, a 
document related to software, a general document, or the like, as suggested by 
Yamamoto (P.11, [0183], lines 4 - 8). 

In regards to claim 47, Yamamoto doesn't teach: 
further comprises an image annotation object that conforms to standard that defines 
data elements In object-oriented terms, each object having a unique tag, name, 
characteristics and semantics. 

However Jain teaches such use (Fig. 1, #104 XML DTD, #108 XML_To_JAVA, #110 
Java Class, #112 Java Class File, #120 Program, #124 Java Object), and (p. 1 , [001 1- 
0012], see Techniques are disclosed for converting an XML document to an object in an 
object-oriented language, thereby providing a structured, programmatic, consistent, 
powerful, and in-memory method for accessing the data in the XML document... In one 
embodiment, a translation tool converts an XML DTD associated with the XML 
document to Java classes from which a Java object corresponding to the XML 
document is Instantiated). 

Yamamoto and Jain are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 
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Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Yamamoto, and Jain before him or 
her, to modify the system of Yamamoto to include the teachings of Jain, as a 
translation tool to converts and XML Document Type Definition file associated with an 
XML document to Java classes from which a Java object corresponding to the XML 
document is instantiated, and accordingly it would enhance the system of Yamamoto, 
which is focused on providing client computers with annotation functions enabling users 
of the client computers to view object-based documents with annotations, to also be 
effectively utilized also for a separate type of a document to be annotated. Such a 
document may be a source program written in another programming language, a 
document related to software, a general document, or the like, as suggested by 
Yamamoto (P. 11, [0183], lines 4 -8). 

19. Claims 9, 11, and 56 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Jain, in view Yamamoto, in further view of Goede. 

In regards to claims 8, 10, and 55, the rejections above are incorporated, 
accordingly. 

In regards to claim 9, Jain doesn't teach: 
the compiling further comprises: targeting the compiling to an instruction set of a 
processor of an imaging system. 

However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
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of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

Jain and Goede are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Goede before him or her, to 
modify the system of Jain to include the teachings of Goede, as a method and system 
for visually annotating an image, and accordingly it would enhance the system of Jain, 
which is focused on a translation tool to converts and XML Document Type Definition 
file associated with an XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated, to define the requirements of a 
digital non raster-based annotation architecture and annotating methodology for digital 
images that will serve as a basis for use in a number of exemplary areas: authoring 
tools, presentation programs, and cataloging systems, as suggested by Goede (P.3, 
[0035], lines 2 - 6). 
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In regards to claim 11, Jain doesn't teacli: 

the imaging system is a medical imaging system. 

However Goede teaclies such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data... Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG, DIGOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
information in a single, non-volatile and portable file or in a separate file from the 
image). 

Jain and Goede are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Goede before him or her, to 
modify the system of Jain to include the teachings of Goede, as a method and system 
for visually annotating an image, and accordingly it would enhance the system of Jain, 
which is focused on a translation tool to converts and XML Document Type Definition 
file associated with an XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated, to define the requirements of a 
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digital non raster-based annotation architecture and annotating metliodology for digital 

images that will serve as a basis for use in a number of exemplary areas: authoring 
tools, presentation programs, and cataloging systems, as suggested by Goede (P. 3, 
[0035], lines 2 - 6). 

In regards to claim 56, Yamamoto teaches: 

• high-level language based apparatus operable to instantiate the selected style 
class object (p. 4, [0070], lines 2-13, see upon receiving the request previously 
handled by the step c3, one of sets of viewing information stored on the server 
10 which corresponds to the selected name, and then transmits the selected set 
of viewing information to the client computer 50. The set of viewing information 
includes: a) document information representing a selected file (document) in a 
format viewable in the Web browser (e.g., a Hyper-Text Mark-up Language 
(HTML) file); b) annotation information representing annotations in a format 
viewable in the Web browser (e.g., an HTML file); and c) a script for allocating 
the annotations to the file (document) (e.g., a JavaScript)). 

• high-level language apparatus operable to receive parsed annotation data and 
the image from the image annotation object through a host image annotation 
parser (p. 4, [0070], lines 2-13, see upon receiving the request previously 
handled by the step c3, one of sets of viewing information stored on the server 
10 which corresponds to the selected name, and then transmits the selected set 
of viewing information to the client computer 50. The set of viewing information 
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includes: a) document information representing a selected file (document) in a 
format viewable in the Web browser (e.g., a Hyper-Text Mark-up Language 
(HTML) file); b) annotation information representing annotations in a format 
viewable in the Web browser (e.g., an HTML file); and c) a script for allocating 
the annotations to the file (document) (e.g., a JavaScript)). 

• high-level language apparatus operable to forward the image and text to a 
graphic utilities object that is native to an operating system that is running on the 
processor (Fig. 1 , #40 bi-directional arrows from server to clients, #50 Clients, 
#10 Web server), and (p. 4, [0063], lines 5-9, see a connection between the 
client computer 50 and the server 10 via the network 40 would allow a user of the 
client computer 50 to access and utilize a Web site (for sending Web pages) built 
on the server 1 0). 

• the graphic utilities object is to generate the annotated image Fig. 1 #50 Client 
Web Browser #51 , see Annotation, and Web Browser). 

Yamamoto doesn't teach: 

• high-level language based apparatus operable to select a style class object that 
is appropriate for imaging of a modality. 

However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see 
FIG. 6 is a diagram showing the data flow carried out in accordance with an 
illustrative embodiment of the present invention. The first step is to extract the 
image data... Digital information can also consist of color settings, grayscale 
levels, image pixel dimensions, or the type of image the user is requesting, i.e.. 
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TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9-13, see The metadata may 
also include patient information in the case of medical images), (abstract, lines 1 
- 6, see A method and system for visually annotating an image. Annotations and 
notes to images, such as digital medical and healthcare images, may be stored 
in a structured vector representation alongside image information in a single, 
non-volatile and portable file or in a separate file from the image). 
• the modality is selected from a group consisting of magnetic resonance, 

computed tomography. X-ray, ultrasound and positron emission tomography (Fig. 
6, and P. 7, [0077], lines 1-13, see FIG. 6 is a diagram showing the data flow 
carried out in accordance with an illustrative embodiment of the present 
invention. The first step is to extract the image data... Digital information can also 
consist of color settings, grayscale levels, image pixel dimensions, or the type of 
image the user is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], 
lines 9-13, see The metadata may also include patient information in the case 
of medical images), (abstract, lines 1 - 6, see A method and system for visually 
annotating an image. Annotations and notes to images, such as digital medical 
and healthcare images, may be stored in a structured vector representation 
alongside image information in a single, non-volatile and portable file or in a 
separate file from the image). 

Yamamoto and Goede are analogous art because they are from the same field 
of endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
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ordinary sl<ill in tlie art, having the teaching of Yamamoto, and Goede before him or 
her, to modify the system of Yamamoto to include the teachings of Goede, as 
a method and system for visually annotating an image, and accordingly it would 
enhance the system of Yamamoto, which is focused on providing client computers with 
annotation functions enabling users of the client computers to view object-based 
documents with annotations, to also be effectively utilized also for a separate type of a 
document to be annotated. Such a document may be a source program written in 
another programming language, a document related to software, a general document, 
or the like, as suggested by Yamamoto (P.1 1 , [0183], lines 4 - 8). 

20. Claims 51, 52, 53, and 54 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Jain, in view of Yamamoto, in further view of Goede. 

In regards to claim 51, Jain teaches: 

• receiving the annotation presentation description and the image annotation 
object, the image annotation object containing text (Fig. 1, note arrow from #104 
to #108, and arrow from #102 to #120), and (p. 1 , [0003], lines 1 - 6, see A 
Document Type Definition file ("DTD") associated with an XML document defines 
how the mark up tags within the document should be interpreted by the 
application presenting the document. The HTML specification that defines how 
Web pages should be displayed by Web browsers is one example of a DTD). 

Jain doesn't teach: 
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• the annotation presentation description further comprises an annotation 
presentation description that is compiled from a non-procedural image annotation 
template. 

However Yamamoto teaches such use (Fig. 1, #104 XML DTD, #108 
XML_To_JAVA, #110 Java Class, #112 Java Class File, #120 Program, #124 
Java Object), and (p. 1, [0011-0012], see Techniques are disclosed for 
converting an XML document to an object in an object-oriented language, 
thereby providing a structured, programmatic, consistent, powerful, and in- 
memory method for accessing the data in the XML document... In one 
embodiment, a translation tool converts an XML DTD associated with the XML 
document to Java classes from which a Java object corresponding to the XML 
document is instantiated). 

• generate and view an annotated medical image, from an image annotation object 
having an image and an annotation presentation description. 

However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51 , see 
Annotation, and Web Browser). 

• invoking the native instructions contained in the annotation presentation 
description and using text from the image annotation object, to generate and 
view the annotated medical image that is annotated with the text from the image 
annotation object. 

However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51 , see 
Annotation, and Web Browser). 
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• has instructions that are native to a processor that is operably coupled to the 
computer accessible medium. 

However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see 
FIG. 6 is a diagram showing the data flow carried out in accordance with an 
illustrative embodiment of the present invention. The first step is to extract the 
image data.. .Digital information can also consist of color settings, grayscale 
levels, image pixel dimensions, or the type of image the user is requesting, i.e., 
TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9-13, see The metadata may 
also include patient information in the case of medical images), (abstract, lines 1 
- 6, see A method and system for visually annotating an image. Annotations and 
notes to images, such as digital medical and healthcare images, may be stored 
in a structured vector representation alongside image information in a single, 
non-volatile and portable file or in a separate file from the image). 
Jain and Goede are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Goede before him or her, to 
modify the system of Jain to include the teachings of Goede, as a method and system 
for visually annotating an image, and accordingly it would enhance the system of Jain, 
which is focused on a translation tool to converts and XML Document Type Definition 
file associated with an XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated, to define the requirements of a 
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digital non raster-based annotation arcliitecture and annotating methodology for digital 
images that will serve as a basis for use in a number of exemplary areas: authoring 
tools, presentation programs, and cataloging systems, as suggested by Goede (P.3, 
[0035], lines 2 - 6). 

In regards to claim 52, Jain teaches: 
the image annotation object further comprises an image annotation object that conforms 
to the Digital Imaging and Communications in Medicine standard (Fig. 6, #616 Generate 
Standard Import Statements, #638 Generate input stream constructor). 

In regards to claim 53, Jain doesn't teach: 
selecting a style class object that is appropriate for imaging of a modality, the modality 
is selected from a group consisting of magnetic resonance, computed tomography, X- 
ray, ultrasound and positron emission tomography; and instantiating the selected style 
class object. 

However Goede teaches such use (Fig. 6, and P. 7, [0077], lines 1-13, see FIG. 6 is a 
diagram showing the data flow carried out in accordance with an illustrative embodiment 
of the present invention. The first step is to extract the image data. ..Digital information 
can also consist of color settings, grayscale levels, image pixel dimensions, or the type 
of image the user is requesting, i.e., TIF, JPEG, DICOM, etc.), and (p. 5, [0056], lines 9 
- 13, see The metadata may also include patient information in the case of medical 
images), (abstract, lines 1 - 6, see A method and system for visually annotating an 
image. Annotations and notes to images, such as digital medical and healthcare 
images, may be stored in a structured vector representation alongside image 
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information in a single, non-volatile and portable file or in a separate file from the 
image). 

Jain and Goede are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Goede before him or her, to 
modify the system of Jain to include the teachings of Goede, as a method and system 
for visually annotating an image, and accordingly it would enhance the system of Jain, 
which is focused on a translation tool to converts and XML Document Type Definition 
file associated with an XML document to Java classes from which a Java object 
corresponding to the XML document is instantiated, to define the requirements of a 
digital non raster-based annotation architecture and annotating methodology for digital 
images that will serve as a basis for use in a number of exemplary areas: authoring 
tools, presentation programs, and cataloging systems, as suggested by Goede (P. 3, 
[0035], lines 2 - 6). 

In regards to claim 54, Jain teaches: 
receiving parsed annotation data and the image from the image annotation object 
through a host image annotation parser (Fig. 1 , note arrow from #104 to #108, and 
arrow from #1 02 to #1 20), and (p. 1 , [0003], lines 1 - 6, see A Document Type 
Definition file ("DTD") associated with an XML document defines how the mark up tags 
within the document should be interpreted by the application presenting the document. 
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The HTML specification that defines how Web pages should be displayed by Web 
browsers is one example of a DTD). 
Jain doesn't teach: 

forwarding the image and text to a graphic utilities object that is native to an operating 
system that is running on the processor, whereupon the graphic utilities object is to 
generate the annotated image. 

However Yamamoto teaches such use Fig. 1 #50 Client Web Browser #51, see 
Annotation, and Web Browser). 

Jain and Yamamoto are analogous art because they are from the same field of 
endeavor, annotation and translation of documents and images. 

Therefore, at the time of the invention, it would have been obvious to one of 
ordinary skill in the art, having the teaching of Jain, and Yamamoto before him or her, 
to modify the system of Jain to include the teachings of Yamamoto, as providing client 
computers with annotation functions enabling users of the client computers to view 
object-based documents with annotations, and accordingly it would enhance the system 
of Jain, which is focused on a translation tool to converts and XML Document Type 
Definition file associated with an XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated, to also be effectively utilized 
also for a separate type of a document to be annotated. Such a document may be a 
source program written in another programming language, a document related to 
software, a general document, or the like, as suggested by Yamamoto (P.1 1 , [0183], 
lines 4 - 8). 
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Response to Arguments 

21 . Applicant's arguments witli respect to claims 1 -81 , on pages 25-34, of the 
response, have been fully considered but they are not persuasive. 
Applicants claim 1 requires: 

A. a translator that is operable to receive a non-procedural image annotation 
template. 

Jain discloses such use (Fig. 1 , note arrow from #104 to #108, and arrow from 
#102 to #120), (p. 1, [0003], lines 1 - 6, "a Document Type Definition file ("DTD") 
associated with an XML document defines how the mark up tags within the 
document should be interpreted by the application presenting the document. The 
HTML specification that defines how Web pages should be displayed by Web 
browsers is one example of a DTD"), and (p. 1 , [0002], lines 1-9, "XML or 
extensible Markup language is a language designed specifically for documents 
that contain structured information... The content may be, for example, words, 
pictures , etc. A document in the XML context refers not only to traditional 
documents, but also to other XML "data formats," which include vector graphics , 
mathematical equations, object meta-data, and other kinds of structured 
information") (emphasis added). Examiner notes that pictures and vector 
graphics are references to "image", "imaging", "imager" or "imaged"; and 
although the exact nomenclature isn't used, the functionality is very much the 
same as Applicant's now claimed invention (emphasis added). 
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B. the translator being operable to translate (Fig. 1 , #108 XML_TO_JAVA) the non- 
procedural image annotation template (Fig. 1, #104 XML DTD) to image 
annotation source code (FIG. 1 , #1 10 JAVA CLASS, #112 JAVA CLASS FILE). 
Jain discloses such use (Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #110 
Java Class, #112 Java Class File, #120 Program, #124 Java Object), (p. 1, 
[001 1-0012], "techniques are disclosed for converting an XML document to an 
object in an object-oriented language, thereby providing a structured, 
programmatic, consistent, powerful, and in-memory method for accessing the 
data in the XML document... In one embodiment, a translation tool converts an 
XML DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated"), and (p. 4, [0070], 
lines 6-13, "the set of viewing information includes: a) document information 
representing a selected file (document) in a format viewable in the Web browser 
(e.g., a Hvoer-Text Mark-up Language (HTML) file); b) annotation information 
representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) 
(e.g., a JavaScript))". Examiner notes that a "JavaScript and HTML file" which 
contains " annotation information representing annotations in a format viewable in 
the Web browser" are "non-procedural image annotation template", and although 
the exact nomenclature isn't used, the functionality is very much the same as 
Applicant's now claimed invention. 
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C. a compiler operably coupled to the translator (Fig. 1 XML_TO_JAVA), the 
compiler being operable to receive the image annotation source code (FIG. 1 , 
#110 JAVA CLASS, #112 JAVA CLASS FILE) and to compile the source code 
into an image annotation executable (FIG 1, #124 JAVA OBJECT). (Examiner 
notes that a compiler has to be used to convert the JAVA CLASS, to a program, 
and then to a JAVA OBJECT, otherwise the invention would be inoperable). 
Jain discloses such use (Fig. 1 , #104 XML DTD, #108 XML_To_JAVA, #110 
Java Class, #1 1 2 Java Class File, #1 20 Program . #1 24 Java Obiect ). (p. 1 , 
[001 1-0012], "techniques are disclosed for converting an XML document to an 
object in an object-oriented language, thereby providing a structured, 
programmatic, consistent, powerful, and in-memory method for accessing the 
data in the XML document... In one embodiment, a translation tool converts an 
XML DTD associated with the XML document to Java classes from which a Java 
object corresponding to the XML document is instantiated"), and (p. 4, [0070], 
lines 6-13, "the set of viewing information includes: a) document information 
representing a selected file (document) in a format viewable in the Web browser 
(e.g., a Hvoer-Text Mark-up Language (HTML) file); b) annotation information 
representing annotations in a format viewable in the Web browser (e.g., an 
HTML file); and c) a script for allocating the annotations to the file (document) 
(e.g., a JavaScript))". Examiner notes that a "JavaScript and HTML files" are 
executable files, which are executed via a Web Browser, and although the exact 
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nomenclature isn't used, tlie functionality is very much the same as Applicant's 
now claimed invention. 

Applicant contends (p. 27, 4"^ para.) that "claims 1,4, 16 and 18-21 require a 
'non-procedural image annotation template.' However Jain does not disclose the words 
'image', 'imaging,' 'imager,' or 'imaged.' Thus, Jain does not disclose claims 1,4, 16 
and 18-21 and the dependent claims 2-7, 17 and 22. Thus, claims 1-7, 16-22 are 
allowable". Examiner respectfully disagrees, see response to claim 1, part A, which has 
been addressed above. 

Applicant contends with respect to claims 28-30, and claims 31-33 (p. 28,4"^ para.), 
that "the word 'template' does not appear in paragraph 70 of Yamamoto, nor does the 
word 'template' appear anywhere in Yamamoto. Thus, Yamamoto does not disclose 
'non-procedural image annotation template.' Thus, claims 28 and 31 and the dependent 
claims 29-30 and 32-33, respectively, are allowable". Examiner respectfully disagrees, 
see response to claim 1, part B, which has been addressed above. 

Applicant contends with respect to claims 34-44 (p. 28, 5"^ para.), that "claim 34 
requires an 'image annotation executable'". Examiner respectfully disagrees, see 
response to claim 1, part C, which has been addressed above. 

Applicant contends with respect to claims 45-50 (p. 29, 2"'', 3'", and 4"" para.), 
that "claim 45 requires an 'annotated medical image', 'medical'... an 'annotation 
presentation description having instructions that are native to a processor'... the word 
'native' is not disclosed by Yamamoto". Examiner respectfully disagrees, see response 
to claim 1 , part A, which has been addressed above. Examiner also notes that 
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Yamamoto's invention would be "inoperable" if the instructions it received were not 
"native" to the processor. 

Applicant contends with respect to claim 75 (p. 29, 5* para.), that "claim 75 
requires 'the computer instructions being native to the process'... However, Yamamoto 
does not disclose the word 'native.' Thus, claim 75 is allowable". Examiner respectfully 
disagrees, it should be noted that the functionality disclosed by Yamamoto is very much 
the same as Applicant's now claimed invention. Moreover; Examiner also notes that 
Yamamoto's invention would be "inoperable" if the instructions it received were not 
"native" to the processor. 

Applicant contends with respect to claims 78-81 (p. 29, 5"^ para.), that "claim 78 
requires 'image annotation executable that includes computer instructions of the new 
annotation calculations that are native to a processor of the medical imaging 
system. '...'however, Yamamoto does not disclose the word 'native'. Thus, claim 78 and 
the dependent claims 70-81 are allowable". Examiner respectfully disagrees, it should 
be noted that the functionality disclosed by Yamamoto is very much the same as 
Applicant's now claimed invention. Moreover; Examiner also notes that Yamamoto's 
invention would be "inoperable" if the instructions it received were not "native" to the 
processor. 

Applicant contends with respect to claim 7 (p. 30, 1^' para.), that "claim 7 
requires 'computer instructions being native to the processor'... However, Goede does 
not disclose the word 'native.' Thus, claim 7 is allowable". Examiner respectfully 
disagrees, it should be noted that the functionality disclosed by Goede is very much the 
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same as Applicant's now claimed invention. Moreover; Examiner also notes that 
Goede's invention would be "inoperable" if the instructions it received were not "native" 
to the processor. 

With respect to claims 51-54 (p. 30, 2"^^ para.). Examiner notes that the response 
by Applicant is similar to the response of claim 7, which has been addressed above. 

With respect to claims 8-12 (p. 30, 5^^ and 6"" para.). Examiner notes that the 
response by Applicant is similar to the response of claims 34-44, which has been 
addressed above. 

Applicant proclaim with respect to claims 13-15 (p. 31, 2"^ para.), that "claim 13 
requires 'compile the image annotation source code into a medical image annotation 
executable, to an instruction set of a processor of a medical imaging system'... 
'However... Yamamoto does not provide any disclosure that approximates the required 
language of claim 1 3 and the dependent claims 1 4-1 5. Thus, claims 1 3-1 5 are 
allowable'". Yamamoto may not provide such use, however Jain discloses such use, 
see response to claim 1, part A, which has been addressed above. 

With respect to claims 23-27 (p. 31 , 3"^ para.). Examiner notes that the response 
by Applicant is similar to the response of claims 1,4, 16 and 1 8-21 , which has been 
addressed above. 

With respect to claims 55-56 (p. 31 , 4"^ and 5"^ para.). Examiner notes that the 
response by Applicant is similar to the response of claim 45, which has been addressed 
above. 



Application/Control Number: 1 0/829,41 7 Page 1 1 2 

Art Unit: 2192 

Applicant contends with respect to claims 59-61 (p. 31 , last para. - p. 32 1st), that 
"none of the reference disclose the DICOM"..."thus, claims 59-61 are allowable". 
Examiner respectfully disagrees, Jain discloses such use (Fig. 6, #616 Generate 
Standard Import Statements . #638 Generate input stream constructor) (emphasis 
added). Moreover, Examiner notes that although the exact nomenclature Isn't used, the 
functionality is very much the same as Applicant's now claimed invention. 

With respect to claims 62-63 (p. 32, 2"^^ para.). Examiner notes that the response 
by Applicant is similar to the response of claims 45-50, which has been addressed 
above. 

With respect to claims 64-74 (p. 32, 3''^ para.). Examiner notes that the response 
by Applicant is similar to the response of claims 45-50, which has been addressed 
above. 

With respect to claims 76-77 (p. 32, 5"^ para.), Examiner notes that the response 
by Applicant is similar to the response of claims 45-50, which has been addressed 
above. 

With respect to claims 36, 39, 46 and 47 (p. 33, 1^' and 2"^^ para.). Applicant 
contends "claims 36, 39, 46, and 47 are dependent claims that are allowable as being 
dependent upon an allowable independent claim". Examiner respectfully disagrees; see 
rejection of their independent claims, which have been addressed above. 

With respect to claims 9, 1 1 , and 56 (p. 33, 3"^ and 4* para.). Applicant contends 
"claims 9, 1 1 , and 56 are dependent claims that are allowable as being dependent upon 
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an allowable Independent claim". Examiner respectfully disagrees; see rejection of their 
independent claims, which have been addressed above. 

With respect to claims 51-54 (p. 33, 5*^^ and 6* para.). Examiner notes that the 
response by Applicant is similar to the response of claims 45-50, which has been 
addressed above. 

Conclusion 

22. Examiner, in light of the above submission maintains the previous rejections. 
Accordingly, THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1 .136(a). 

23. A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Correspondence Information 

24. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Evral Bodden whose telephone number is 571 272 
3455. The examiner can normally be reached on Monday to Friday, 8:30 to 5:00. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Tuan Dam can be reached on 571-272-3695. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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